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ABSTRACT. 

We continue our presentation of mathematically rigorous results about the Sherrington- 
Kirkpatrick mean field spin glass model. Here we establish some properties of the dis- 
tribution of overlaps between real replicas. They are in full agreement with the Parisi 
accepted picture of spontaneous replica symmetry breaking. As a byproduct, we show 
that the selfaveraging of the Edwards-Anderson fluctuating order parameter, with re- 
spect to the external quenched noise, implies that the overlap distribution is given by 
the Sherrington-Kirkpatrick replica symmetric Ansatz. This extends previous results of 
Pastur and Shcherbina. Finally, we show how to generalize our results to realistic short 
range spin glass models. 
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1. INTRODUCTION. 

The physical content of the Sherrington-Kirkpatrick mean field spin glass model [1,2] is 
fully contained in the probabilistic distribution of overlaps between replicas of the system. 
In the approximate Sherrington-Kirkpatrick Ansatz [1], this distribution is concentrated 
on a numerical order parameter, while in the more complete Parisi treatment [2], based 
on replica symmetry breaking, the distribution shows ultrametric features and can be 
expressed through a functional order parameter (see also [3,4,5]). 

We have found a general very elementary method able to generate rigorous relations 
between replica averages, also in the infinite volume limit. The method is based on simple 
analysis of fluctuations. The purpose of this paper is to show some applications of this 
method. 

If we consider four replicas, dubbed 1,2,3,4, as defined in the following, then the 
ultrametric picture gives a very simple statement about the joint distributions of the 
overlaps (?i2,?23 and <?i2,<?34, respectively. Roughly speaking, for the joint distribution of 
Qi2, 923, it says that the distribution of <j»23 is such that ^23 is equal to q\2 with probability 
one half, and independent from qi 2 with the same probability one half. Notice that the 
statement does not depend on the precise form of the Parisi functional order parameter, 
neither on the temperature. In this case the overlaps q±2, 923 have one replica in common. 
If we consider the overlaps 512, Q34, among disjoint replicas, then the statement is the same 
as before, with the probabilities one half - one half replaced by one third - two thirdies, 
respectively. The fact that two overlaps, as (/i2,<?34, related to disjoint replicas, are not 
completely independent is very peculiar to the ultrametric picture, and is a consequence of 
the important phenomenon of the absence of selfaveraging for some fluctuating observables. 

As an example of application of our general method, we will give a very simple rigor- 
ous proof for the following equalities among overlap averages, direct consequences of the 
previous ultrametric statements, 



In a recent paper [6], Marinari, Parisi, Ruiz-Lorenzo and Ritort have found, among 
other things, convincing numerical evidence, based on computer simulations on large sys- 
tems, that these equalities hold also for spin glass systems with short range interactions. 
This provides support to the idea that some relevant features of the ultrametric picture 
survive also in the transition from the mean field model to more realistic disordered short 
range interactions (but see also [7]). 

While it is true that the overlap distributions do not reproduce the full physical con- 
tent of the short range models, nevertheless it is interesting to notice that our methods 
are able to establish equalities (1,2), also in the short range case, modulo some technical 
assumptions about the infinite volume limit, in full agreement with the computer simula- 
tions. 

As a byproduct of our analysis, we can also establish rigorously that selfaveraging of 
the Edwards-Anderson fluctuating order parameter implies that the overlap distribution is 



(^3 2 4) = ^(^2) + ^(^2) 2 - 



(1) 



(2) 
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trivially given by the Sherrington-Kirkpatrick replica symmetric Ansatz, through a simple 
numerical order parameter. The precise statements are presented in the following, but we 
can see immediately from (2) that selfaveraging of the fluctuating order parameter would 
imply, in the infinite volume limit, that 



In this case, all overlaps would be constant. 

It is expected that for high temperatures and/or high values of the external field the 
model exhibits selfaveraging (see for example [8] and [3]), but for zero external field and low 
temperatures our result shows that there can not be selfaveraging, because the Sherrington- 
Kirkpatrick replica symmetric Ansatz then becomes incompatible with positivity of the 
entropy. 

Our results, about lack of selfaveraging, complement previous similar results by Pastur 
and Shcherbina [9] and Shcherbina [10], where they consider fluctuating order parameters 
coming from the response of the system to suitably chosen external random fields. 

The paper is organized as follows. In Section 2, we recall the basic definitions of the 
mean field spin glass model, and introduce the overlap parameters and their averages, in 
connection with the thermodynamic observables of the theory. In particular, we show how 
to express the specific internal energy and its temperature derivative, and the quadratic 
fluctuations for the internal energy and the order parameter in terms of overlap averages. 
In Section 3, we exploit simple positivity properties in order to prove some ultrametric 
inequalities. Then, we show that selfaveraging for the fluctuating order parameter implies 
that all overlaps are constant, according to the replica symmetric Ansatz. Section 4 is 
devoted to the proof of the metric equalities. We will exploit the properties of selfaveraging 
for the specific free energy and the internal energy. Finally, Section 5 gives some conclusions 
and outlook for future developments. 

In conclusion, useful conversations with Roberto D'Autilia, Enzo Marinari, Giorgio 
Parisi and Masha Shcherbina are gratefully acknowledged. We would like to thank also 
Charles Newman and Dan Stein for making available Ref. [7] before publication, and useful 
correspondence. 



(9l2934> = (9l2) (934) = (?12> 



(3) 



and therefore 




(4) 



3 



2. OVERLAP DISTRIBUTIONS. 

The mean field spin glass model is denned on sites % = 1, 2, . . . , N, to which Ising spin 
variables <7j = ±1 are attached. The external quenched disorder is given by the N(N — l)/2 
independent and identical distributed random variables Jij, defined for each couple of 
sites. For the sake of definiteness, we assume each Jij to be a centered unit Gaussian with 
averages 

£(J y ) = 0, E(4) = l. (5) 
The Hamiltonian of the model is given by 

H N (a, J) = -L V JijOiOj, (6) 

where the sum, extending to all spin couples, and the normalizing factor 1/y/N are typical 
of the mean field character of the model. 

For a given inverse temperature (3, we introduce the partition function Zn(P, J), the 
free energy per site /n(P,J), the internal energy per site un(/3,J), and the Boltzmann 
state uj, according to the definitions 

Z N (/3,J)= exp(-fiH N (a,J)), (7) 

U\ ...crjv 

-f3f N (f3,J) = N- 1 logZ N (^J), (8) 
u J (A) = Z N (P,J)- 1 AeM~PH N (a,J)), (9) 

fTi...fJjv 

u N (p, J) = N^ujiH^a, J)) = dfi(Pf N (P, J)), (10) 

where A is a generic function of the cr's. In the notation uj, we have stressed the de- 
pendence of the Boltzmann state on the external noise J, but, of course, there is also a 
dependence on /3 and N. 

We are interested in the thermodynamic limit iV — > oo. 

Let us consider a generic number s of independent copies (replicas) of the system, char- 
acterized by the Boltzmann variables cr^\ . . ., distributed according to the product 



state 



ilj — Uj Uj . ..Uj , (11) 



where all Wj™' act on each one a % ^ s, and are subject to the same sample J of the external 
noise. 

The overlaps between two replicas a, j3 are defined according to 

o-f^'.^^EW (12) 

i 

with the obvious bounds 

"I < Qa/3 < 1. (13) 
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For a generic smooth function F of the overlaps, we define the averages 

EQj(F(Q 12 ,Q 13 ,...)), (14) 

where O j acts on the a variables, and E is the average with respect to the external noise J. 
We introduce also random variables qi 2 , Q13, . . ., through the definition of their averages 

(F(q 12 , 913, •••))= Enj(F(Q 12 , Q 13 , ...))• (15) 

We have made a careful distinction in notations. In fact, ( ) contains both Boltzmann 
averages fij and noise averages E. 

It is important to remark that the noise average E introduces correlations between 
different groups of replicas. For example, before the E average, we have the factorization 

nAqUi,) = (4 1} 4 2) )(^2) (4 3) 4 4) )(A)- (i6) 

But after the E average we have in general 

<<7l2?3 2 4> * <«?2><&>- (17) 

The ( ) averages are obviously invariant under permutations of the replicas, so that 
in particular 

(q 2 i2) = (qD- (is) 

Moreover, they are invariant under gauge transformations 

q a /3 ->■ t a epq a fi, (19) 

where e a = ±1. This is an easy consequence of the fact that each Wj Q ' is an even state on 
the respective cr's. 

There are important consequences from gauge invariance. First of all, polynomials in 
the overlaps, which are not gauge invariant, have zero mean. Moreover, the distributions 
are uniquely defined by their restrictions to the case where all values of the q's are nonneg- 
ative. The general case, in all regions of possible values for the g's, is easily reconstructed 
using gauge invariance. 

Overlap distributions carry the whole physical content of the theory. In fact, the 
averages of the physical observables with respect to the external noise can be expressed 
through averages involving overlap functions. As an example, we give the following state- 
ments involving the internal energy, its (3 derivative and its quadratic fluctuations. 

Theorem 1. The noise average of the internal energy is given through an overlap average 
of the type 

E(u N (f3, J)) = N~ 1 E(ujj(Hn{o', J))) = - (q 2 12 )). (20) 

Theorem 2. The (3 derivative of the noise average of the internal energy is expressed as 
df,E(u N (P, J)) = -N- l E{uj{H 2 N )-u 2 j{H N )) 

= ~(1 ~ <3l 2 2» + Y N (^ - 4 <Sl292 2 3> +3<<Z 2 2 ? 3 2 4»- (21) 
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Theorem 3. For the quadratic fluctuation of the internal energy we have 

E(u 2 N (P, J)) - {Eu N (p, J)) 2 = N- 2 (e{u 2 j{H n )) - {Euj{H N )) 2 ) 
= -^i 2 2> " -^2 + ^ 2 ((?i 2 2?3 2 4) - (q 2 ^)) + ^ 2 ((^ 2 ) - (q 2 i2) 2 )- (22) 



The proof of these results is very straigthforward, but it involves long calculations. 
The main ingredient is nothing but integration by part with respect to the external noise. 
In fact, for a unit Gaussian J and a smooth function F, we have 

E(JF{J))=E(j 1 F{J)). (23) 

As an example, we recall the proof of (20) (see [2], and [3]). Starting from the defini- 
tions (6,9,10,12), we can write the following chain of equalities 

- E(u N (l3, J)) = -N^E^AH^a, J))) = -L= £ Efaujiwj)) 



N ^ N (U, 

^ E(i - = z(i - m^))) 

?2 



= ^(l-(? 2 2 )). (24) 



Notice that we have changed the sum over all couples into one half of the sum 
over all % and j, by taking into account that the diagonal elements, corresponding to % = j, 
do not give any contribution. Formulae (21) and (22) are established in a similar way. They 
involve a double integration by parts, since the Hamiltonian appears quadratically. 

We can also introduce the fluctuating order parameter 

M%%J) ^E^W^/W.), (25) 

and notice that 

E(M*(/3, J)) = (q 2 12 ), E(M 4 N (P, J)) = (26) 
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3. CONSEQUENCES OF SELFAVERAGING. 

Since (21) is clearly nonpositive, and (22) nonnegative, we have immediately the following 
bounds 

(^2 2 3> > \{q\ 2 ) + |<«? 2 &> + O(l), (27) 

<9l 2 &> < + " (q 2 12f) + O(^). (28) 

Now we are ready to establish 
Theorem 4. The following estimates hold 

(&&)>\(&) + \(&) 2 + 0(±), (29) 

(^3 2 4)>^9 12 ) + ^(?i 2 2) 2 + 0(l). (30) 

In order to prove (30), it is sufficient to eliminate (Q12Q23) between (27) and (28). 
Then, (29) follows from the elimination of (^12934) between (30) and (27). 
An obvious consequence of (29,30) is the following 

Theorem 5. In the limit for N — > 00 we have 

liminf - \(q\ 2 ) - Uq^f) > 0, (31) 

N— s-oo 11 

hminf ((qf 2 qj 4 ) - \(qf 2 } - |<^ 2 > 2 )) > 0. (32) 

N— too 3 3 

Notice that the results of Theorem 4 and Theorem 5 rely only on positivity properties 
for the expressions (21,22). 

Finally, we can connect the quadratic fluctuations for the order parameter defined in 
(25) with the quadratic fluctuations for the overlap q\ 2 . In fact, from (26) and (30), we 
immediately have 

Theorem 6. The following estimate holds 

< <<&> - (q 2 12 f < 3(E{MUfr J)) ~ E 2 {M 2 N (P, J))) + 0{±). (33) 

Therefore, we have a simple proof of the following very important result 

Theorem 7. Assume that the order parameter Mjy is selfaveraging in the infinite volume 
limit, in the sense that for N — > 00 along some subsequence we have 

lim (E(M%(P, J)) - E 2 {M 2 N {(3, J))) = 0. (34) 

Then, along the same subsequence 

hm ((qi 2 )-(q 2 l2 f)=0. (35) 
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If, moreover, we chose N — > oo along a subsequence such that 

lim (q 2 l2 ) = q\ (36) 

TV— >oo 

where for example 

q 2 = limsup (qf 2 ), (37) 

TV->-oo 

then along the same subsequence we have for any gauge invariant function F 

lim (F(q 12 ,q 13 ,...)) = F(q,q,...), (38) 

N— too 

so that the overlaps have the Sherrington-Kirkpatrick replica symmetric form. 

Clearly, (35) follows from (38) through (33), while (38) is a simple consequence of the 
absence of dispersion for the overlaps. 

This result complements previous results by Pastur and Shcherbina [9] , and Shcherbina 
[10], where they prove that quadratic selfaveraging for some order parameters, coming from 
the response of the system to random external fields, implies the Sherrington-Kirkpatrick 
form for the solution of the model. 



4. THE ULTRAMETRIC EQUALITIES. 

In [9], Pastur and Shcherbina have proven the selfaveraging of the free energy per site 
in quadratic mean, in the infinite volume limit. In fact, by a mild improvement of their 
methods, one can easily show [11] the following 

Theorem 8. The quadratic fluctuation of the free energy per site can be estimated as 
follows 

E^N' 1 log Z N (f3, J)) 2 ) - (E'(iV~ 1 \ogZ N (P, J))) 2 < ^(q 2 12 ) +0(±). (39) 



By using standard techniques of statistical mechanics, one can easily derive state- 
ments about the quadratic fluctuation of the internal energy. A precise formulation is the 
following. 

Let N go to infinity along a subsequence such that the average specific energy is 
convergent 

lim N- 1 E log Z N {/3, J)) = -/3/(/3). (40) 

TV— >oo 

Due to convexity in (3 the subsequence can be chosen without exploiting compacteness 
or the axiom of choice [11], as for any subsequence in this paper, by working for example 
always with lim sup's for a denumerable dense set of /3's. 

Since the function — /3f(/3) is convex in /3, there exist the left and right j3 derivatives 
u (±)(/3), and, moreover, they are equal for all values of /3, with the possible exclusion of a 
set of zero Lebesgue measure. Then, we have [11] 
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Theorem 9. For N going to infinity, along the chosen subsequence, the quadratic fluctu- 
ation of the specific internal energy satisfies 

hmsup(i?«(/3, J)) - (Eu N (f3,J)) 2 ) < \{u {+) {(5) - u^)) 2 . (41) 

Therefore, we have quadratic selfaveraging for almost all values of (3. 

For a complete detailed proof of Theorem 8 and Theorem 9, we refer to our forthcoming 
review paper [11]. 

^From now on, we let N — > oo along subsequences such that not only the specific free 
energy but also the averages (q 2 2 ), (112)1 (?i2?23)' (li2l 2 4) have well definite limits. 
An immediate consequence of Theorem 3 and Theorem 9 is the following 

Theorem 10. In the limit N — > 00 along the stated subsequence, for almost all values of 

(3, we have 

- <^2 2 3> = |«g? 2 > " (4 2 2> 2 )- (42) 

Further information can be gathered from (20,21). In fact, at fixed N, by taking the 
f3 derivative in (20), and by exploiting (21), we have 

-\ + \^(q 2 12 ) = ^NAl{(3), (43) 
where we have defined the nonnegative A 2 N (f3) through 

A%(P) = <<&> " M&dls) + 3<9? 2 <&> - (1 - (&))■ (44) 
Let us integrate (43) in dfi 2 on the generic interval [/9 2 ,/9|], with < fi\ < j3%. We 

have 

/3 2 2 

J p2 2 A%(PW 2 = § - <5? 2 >#) - ^ log |- (45) 

Therefore, we have that A 2 N (f3) converges to zero in quadratic mean in any (3 2 interval. 
We can extract a subsequence such that A 2 N (f3) converges to zero, for all values of f3, by 
excluding a set of zero Lebesgue measure. By recalling the definition (44), we then arrive 
at 

Theorem 11. In the limit N — > 00 along the stated subsequence, for almost all values of 

(3, we have 

(9i 2 ) " MQ 2 i2Q 2 2s) + HqWza) = 0. (46) 

By collecting all results of Theorems 10 and 11, we can establish the following equal- 
ities, in full agreement with the Parisi ultrametric solution of the mean field spin glass 
model. 

Theorem 12. For almost all values of /3, and for N going to infinity along a chosen 
subsequence, we have in the limit 

(^) = \(^) + \(^)\ (47) 
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(48) 



Therefore, we have proven the main result of this paper. The possible restrictions on 
the values of j3 and the limiting subsequences are a consequence of the method of proof. In 
fact, we believe that all results are true for any value of (3 and N going to infinity without 
restrictions. But we would need a better control on the limits. 

It is immediate to generalize the results of Theorem 12 to models with short range 
interaction. In fact, we can add to the interaction Hamiltonian of the short range model a 
small mean field interaction of the type XH^, with defined as in (6). By taking A — > 0, 
after the infinite volume limit, we still have (47,48). The general validity of (47,48) is also 
confirmed by numerical simulations [6]. 

5. CONCLUSIONS AND OUTLOOK FOR FUTURE DEVELOPMENTS. 

In conclusion, we can see that all results explained in this paper rely on very elemen- 
tary arguments, based essentially on positivity and convexity. These results are easily 
generalized. 

For example, we can add a small interaction of the form 



where the Jj are independent centered unit Gaussian external noises. By repeating all 
arguments in this paper, we immediately establish equalities of the type 




(49) 




(47) 




(48) 



In a forthcoming paper, we will show other applications of this method. 
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